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Abstract 

With the aim of describing a general benchmark for several complex 
systems, we analyze, by means of statistical mechanics, a sparse network 
with random competitive interactions among dichotomic variables pasted 
on the nodes. 

The model is described by an infinite series of order parameters (the multi- 
overlaps) and has two tunable degrees of freedom: the noise level and the 
connectivity (the averaged number of links) . 

We show that there are no multiple transition lines, one for every order 
parameter, as a naive approach would suggest, but just one corresponding 
to ergodicity breaking. We explain this scenario within a novel and simple 
mathematical technique via a driving mechanism such that, as the first 
order parameter (the two replica overlap) becomes different from zero due 
to a real second order phase transition (with properly associated diverg- 
ing rescaled fluctuations), it enforces all the other multi-overlaps toward 
positive values thanks to the strong correlations which develop among 
themselves and the two replica overlap at the critical line. 



1 Introduction 

Among several different complex systems [8] [21] and a large amount of tools for 

their investigation [16] [19], statistical mechanics of disordered systems earned 

an always increasing weight in the last two decades [1] [14]. 

In this paper, the complex networks we analyze by statistical mechanics can be 

understood as follows: they are networks because we allow the variables to live 

on the node of a non trivial graph (a Poissonian Erdos-Renyi graph [8]), the 

links among the nodes being the interacting fields they exchange. 

They are complex because, as opposite i.e. to the Ising model [3] (in which 

all the variables share the same coupling constants) here the variables interact 

with equal probability via a positive coupling or a negative one, giving rise to 

frustration [14] and forming what is often called, in the language of statistical 
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mechanics, a diluted spin glass [11] [20], while, its zero temperature limit is 
known, in the language of the theoretical computer science counterpart, as a 
pairwise Random X-OR-SAT [15] (strictly speaking random satisfability prob- 
lems deal with p-spin models where interactions happen in groups larger than 
couples [13]; this is not a minor point as criticality in these systems is related 
to the p = 2 case, while for p > 3 the phase transition is discontinuous [4] [7], 
even though not first order in the sense of Ehrenfest [12] as there is no latent 
heat [9]). 

As these models are not Gaussian, they need not just a (functional) order pa- 
rameter (i.e. q 2 ) as their fully connected counterpart (i.e. the SK model [14]) 
but the whole series of multi-overlaps (i.e. 92,94, ■•■,<?2n [H] [20]) and one may 
ask if there are several transition lines for these multi-overlaps (one for every 
of them) or they share the unique transition line at which ergodicity breaks 
(the critical line for 92)- In a previous recent work [6] we proved only mathe- 
matically, by bounds, the latter scenario to be the correct one, but the physics 
behind was still rather obscure and in particular no ideas concerning the nature 
of this transition were presented. 

In this paper we show both mathematically (extending our previous results) 
and physically (offering a picture for the nature of the transition) a complete 
scenario as follows: At the boundaries of the ergodic region the fluctuations of 
the first order parameter (i.e. q 2 ) start diverging, accordingly to a well-defined 
second order phase transition, while the fluctuations of all the others do not 
(suggesting the validity of the several transition alternative); however, due to 
the strong correlations that develop at the critical point among all the order 
parameters, this growth to a non zero value for q 2 drives all the others toward 
its direction, acting as an 'ad hoc' field in the space of these parameters. So the 
transition for the multi-overlaps surprisingly is nor first order neither second 
order; it is a driven transition via a self-generated coupling field which raises on 
the broken ergodicity line. 

2 Equilibrium thermodynamics of the sparse frus- 
trated network 

Consider N nodes, indexed by Latin letters etc., with an Ising spin <7j = ±1 
attached to each of them. Let P a N be a Poisson random variable of mean 
Q.N , let { </„} be independent identically distributed copies of a random variable 
J with symmetric distribution. For the sake of simplicity (but without loss 
of generality) we will assume J = ±1. We consider randomly chosen points, 
we therefore introduce {v}, {ju} as independent identically distributed random 
variables, with uniform distribution over 1,...,N. The Hamiltonian of the 
model (a suitable version of the Viana-Bray [20] one) is the following symmetric 
random variable 

H N (a,a;J) = - ^ J v Vi v Vj„ , a E K + . (1) 
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The non-negative parameter a is called connectivity. 

The Gibbs measure u) and the partition function Zn([3) are defined by 

<«>(¥>) = -^5>xp(-/3tf(a)Ma), Z^(/3) = ]T exp(-/3^( £ r)) , 

cr cr 

where <p : { — 1, +1}^ — ► 7£ and /3 is the noise level in the network. 
When dealing with more than one configuration, the product Gibbs measure 
is denoted by SI, and various configuration taken from each product space are 
called "replicas" . E is the expectation with respect to all the (quenched) vari- 
ables, i.e. all the random variables except the spins, collectively denoted by 
J and we preserve the symbol (.) for EO(.). Sometimes we will deal with a 
perturbed Boltzmann measure, whose perturbation is triggered by a tunable 
parameter t and we stress the dependence on such a perturbation with a sub- 
script t on the averages (.) — > (.) t . 
The (quenched) free energy density Jn is defined by 

A N (0,a) = -AM/3, a) - ^ElnZ N (0, a) . 

The whole physical behavior of the model is encoded by the even multi-overlaps 
<7i---2ti [6], which are functions of several configurations . and defined 

by 

i N 

1 V"^ (!) (2™) 
qi-2n = x2^°i'---< ■ 

i=l 

For the sake of simplicity, often we will denote by 9 = 8(0) the expression 
tanh(/?J) = tanh(/3). 

Looking for order parameter responses, in these networks, one usually per- 
turbs the system with a random field so to have 

N 

H N (<j, h) = H N (a) +Y, h * . ( 2 ) 

i=l 

where the tilde stands for the perturbed Hamiltonian, hi are the random fields 
acting on the spins and t € [0, 1] a tuning of the amplitude of the perturbation, 
eventually sent to zero afterwards (of course h(0) = 0). 

In our approach, due to the randomness of the coupling J and the gauge in- 
variance of the model (the transformation a — > ere, with e ± 1 which leaves the 
Hamiltonian unaffected being e 2 = 1) we can think at the random perturbation 
as a term hi ~ ^2 v 2at Jv<Ji„ then, by applying the gauge ct^ — ► (Ti„<rjv+i, Vi„, we 
can turn the perturbation into a cavity field, mirroring an unperturbed system 
made by N + 1 spins (whose properties are the same of the TV-spin system, for 
large N). 

Notice that, thanks to the additivity property of the Poisson variables, we can 
also write, in distribution, 

N ^ - 

H N+1 (a;a) ~ H N (a;a) + h T (Ti, a = a — - ^ ,h T = - ^ J » a k» ■ ( 3 ) 
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Let us define further a cavity function \& N,t{oi, /?) as the following quantity: 

* Ntt (a, [3) = E In u (e" ) . (4) 

Note that the cavity function takes into account the perturbation applied to the 
original Hamiltonian; it plays a fundamental role in the expansion of the free 
energy as it is immediately clear by the next theorem [2] [6]: 

Theorem The following relation among free energy, its connectivity increment 
and cavity function holds in the N — > 00 limit: 

A N ( ai [3)+ad a A N {a,[3) = In 2 + *j\r,t=i («,/?)< (5) 

The next two straightforward propositions express explicitly the two term by 
which the free energy can be decomposed thanks to eq. ([5]). 

• The incremental contribution to the free energy by the connectivity is [6] 

00 

ad a A(a,[3) = 2a ]T —9 2n {\ - (q 2 2n )). (6) 
1 

• The cavity function can be represented by the integral of the series of all 
the tillable multi-overlaps weighted by the powers of 8 [6] : 

* N , t (J3, a) = f 2a V ±6 2n (f3J)(l - (q 2n )' t )dt' . (7) 

The next two propositions help us in understanding how to deal with these two 
expressions: 

• Robustness states that all the multi-overlaps which are "filled" , i.e. they 
have each replica appearing an even number of times (like ((Jfc), (91234) j 
(91293491234)) are not affected by the perturbation. 

More sharply In the N — > 00 limit, the average (-) t of filled monomials is 
not affected by the presence of the perturbation modulated by t, that is, 
for instance, 

/ (9l29239l3)trf« = / (9l29239l3)<*5 , 
J ai J a± 

V[cSi,a2]- We call this property of filled monomials "robustness" [5]. 

• Saturability states that, once called " fillable" the other multi-overlap mono- 
mials, in the t — ► 1, N — > 00 limits, fillable monomials become filled (i.e. 
liniAr^oo limt-,1 (q 2 ) t = (gf), Iimjv-K» Iimt- > x{?i2g34)t = (91293491234))- 
More sharply, let 91... 2n be a fillable monomial of the multi-overlaps, such 
that 9i...2n<2i- -2n is filled. Then 

lim (qi...2n)t=l = (9l-2nQl-2n) • 
N— >oo 

We refer to this property as "saturability" [5]. 
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To obtain a stochastically stable and gauge invariant iterative expression for 
the free energy, we have to expand the cavity function via filled monomials: 
Neglecting orders higher than (2a9 2 ) 2 we get 

9 N ,t{a,0) = J dt' 2a(y(l - (qM + y(l - (91234)*') + .■•)■ (8) 

which can be filled by expanding its internal multi-overlap monomials (i.e. 
(q 12 ) t = 2a9 2 t{q 2 l2 ) + 0(t 2 ), (91234)* = 2a9H(q 2 23i ) + 0{t 2 )) and than trivially 
integrated back thanks to robustness. 

We can now use Eq.([5]) to write down our free energy expansion of the model. 
Presenting just the first orders, and remembering that we call r = 2a9 2 , we 
have 

A(a,/?)=ln2 + (I - 1(1 r9 a )(q 2 12 ) + £ (q 12 q 23 q 13 ) + ...) (9) 

+ (^)'(^ - - ^ 2 )(9?234> + ^(91234912934) + ...) + ... 

Note that in the high connectivity limit [11] the expression © approaches the 
well known expression for the free energy of the SK model [2] [14]. 



3 Order parameter fluctuations and uniqueness 
of critical line 

The multi-overlaps among any 2n configurations is typically small in the ergodic 
region defined by 2atanh 2 (/3) = 1 and their fluctuation can be studied on the 
N scale by defining 

1 N 

V 2n=VNq2n = ^J2 (X l- (r i n - ^ 



Then it is possible to show that these rescaled multi-overlaps behave, in this re- 
gion, like independent centered Gaussian variables, in the infinite volume limit, 
and the following theorem holds [11]: 

Theorem In the annealed region 2atanh 2 (/3) < 1 the variables r\2n converge 
to centered Gaussian process with covariances 



1 

(1 - 2aEtanh 2 "(/3J)) 
(Va 1 ,...,a 2n r]b 1 ,...MJ = «/ 3« : a, ^ h (12) 



and, when the boundary of the annealed region is approached, only the variance 
of r\2 diverges. This theorem for the fluctuations of qi and for finding its critical 
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line is straightforward within our method so we sketch the proof: 
Sketched proof At first we expand the 2-rcplica overlap 

(q 12 ) t = 2a9 2 (q 2 2 ) - 4a 2 9 4 (q 12 q 23 ) t + 0(q 3 ). (13) 

Then, by simple polynomial integrations, we can evaluate the overlap expansion 
in terms of filled monomials. 

(q 12 ) t = 2a9 2 (q 2 2 )t - 4a 2 9 4 [ dt' f dt" (q 12 q 23 q 13 ) + 0(q 6 ). (14) 

Jo Jo 

Now, by applying " saturability" , we get (912)4 — (q 2 2 ), consequently, forgetting 
0(q 4 ) terms and multiplying by N, we have 

. 2 . 2(2a9 2 ) 2 . . 

(%) = (i_(2 Q fl2)) (^rtoW- (15) 

We see that at the r.h.s. the overlap order is 3 while at the l.h.s. is 2: By a 
Central Limit Theorem argument we see that the only diverging point, for the 
rescaled overlap fluctuations is 2a9 2 = 1, where the r.h.s. denominator explodes 
□ . 

To try and show our physical picture, let us start by the following theorem: 

Theorem Given two integer numbers c, d such that cd = 2n and m € -/V the 
following families of bounds hold generically and also at finite N: 

(C) > <CcC + 1..2c-"<?cVl) + 1..2n> ^ (^.c) d (16) 

Sketched proof Always using q 2 and q^ as examples, we prove the theorem for 
c = d = 2 and m = 1. Its generalization is straightforward. 
Exploiting the factorization of the Boltzmann state at fixed J one has 

(91234) =El^> 4 (a,) >E(1]>>V 4 )) 2 =Euj 2 ( qi2 ) > (ELo(q 12 )) 2 = (q 12 ) 2 , 

i i 

where we have used E[a 2 ] > E 2 [a] for any real- valued random variable, first for 
a = Lo A (ai) and with the expectation taken over the uniform distribution on 
i = 1, ...,N and then for a = oo{qi 2 ) with the expectation over P(J).D 
The conclusion is that it is not possible to have several spin glass transitions in 
any model: as soon as {qi 2 } becomes nonzero, also (91234) must be, and so on. 
The mechanism we provide is again ultimately based on saturability. In fact at 
the critical point the fillable multi-overlap (912934), applying saturability, gets 

Jim lim(gi2934)t = (91293491234), (17) 

N^oo t— >1 

which couples the first multi-overlap q 2 and the second multi-overlap q^ together, 
generating the correlation which drives the transition for (91234). Saturability 
can be applied as we are at the boundary of the ergodicity breaking (the last 
point in which it still holds due to a real second order phase transition of 92)- 
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So remembering once more that we are taking just the first two multi- 
overlaps but the scheme applies to all them and, for the sake of the clearness 
consequently forgetting all the higher order not necessary terms, we can write 
the free energy, that we call f(q2, 94) stressing the dependence by the two multi- 
overlaps as 

f(q 2 , qi ) = {e-(^)ql + (9-(^-)i)qj *£-<gq 4 (18) 

and we want to know how the minima of 7(92,94) evolve with 9 (at fixed a, 
or viceversa). If a bifurcation analysis of the saddle point equations from the 
origin is performed, one would find two transition lines, 9 q2 = (l/2a) 1//2 and 
9 q4 = (l/2a) 1 / 4 . However, when looking at the actual minima it is possible to 
see just the first transition. After that the two minima are away from the origin 
and so the second " potential transition line" at 9 qi = (j^) 3 never appears: when 
approaching this line the system is already in a completely different part of its 
phase space. We stress that above 2a9 2 = 1, where the quadratic expansion of 
f{q2,qi) around the origin determines the Gaussian fluctuations, 92 and 54 are 
uncorrelated, than, below this line, the third-order term produces an interaction 
(91293491234) and so, as soon as 92 becomes non zero, it also drives 94 to a non 
zero value. It is also straightforward to check that near 2a9 2 the minima scale 
as 92 ~ {2a9 2 — l) 1 / 2 , 94 ~ (2a9 2 ) <~ q\ accordingly with the proved scaling for 
random spins at criticality [6]. 

4 Summary 

In this paper we analyzed the genesis of the phase transition in frustrated sparse 
networks, by matching a rigorous approach (essentially based on modern cavity 
interpolation [2]) with a theoretical picture (essentially provided via replica 
trick [20]). Overall a clear scenario for the transition in these systems has 
been achieved: at the onset of ergodicity breaking the first order parameter 
(i.e. 92) undergoes a second-order phase transition; due to the correlations 
among this parameter and all the others (i.e. 94), it drives the latter to a 
positive value too. The positivity of the values assumed by these parameters 
(another prescription of Parisi theory [14]) is a straightforward application of the 
saturability property on themselves. This has interesting consequences, ranging 
from disordered statistical mechanics to computer science as well as random 
matrix theory. On the same line, we stress that in recent years, even on the 
last subject [17], an increasing formalization (avoiding replicas), from Girko's 
framework [10], has been achieved [18]. 
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